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ABSTRACT 


Dijt 


We  consider  the  interpretation  of  time  series  data  from  firing  events  in  periodically 
stimulated  sensory  neurons.  The  neurons  are  represented  as  nonlinear  switching  ele¬ 
ments  embedded  in  a  Gaussian  noise  background.  The  cooperative  effects  arising 
through  the  coupling  of  the  noise  to  the  modulation  are  examined,  together  with  their 
possible  implications  in  the  features  of  Inter- Spike- Interval  Histograms  (ISIHs)  that  are 
ubiquitous  in  neurophysiological  experimental  data.  Our  approach  provides  the  simplest 
posible  interpretation  of  the  ISIHs  and  has  been  found  to  reproduce  the  salient  features 
of  experimental  ISIHs.  One  such  comparison,  between  very  recent  data  from  experi¬ 
ments  performed  in  St.  Louis,  on  the  mechanoreceptor  in  the  tailfan  of  the  crayfish 
Procambants  clarkii,  and  analog  simulations  on  a  simple  nonlinear  exciteable  neural 
model  is  presented  to  elucidate  this  point. 


INTRODUCTION 


Neuroscientists  have  known  for  decades  that  sensory  information  is  encoded  in  the 
intervals  between  the  action  potentials  or  "spikes’  characterizing  neural  firing  events. 
Statistical  analyses  of  experimentally  obtained  spike  trains  have  shown  the  existence  of 
a  significant  random  component  in  the  inter-spike  intervals.  There  has  been  speculation, 
of  late,  that  the  noise  may  actually  facilitate  the  transmission  of  sensory  information; 
certainly  there  exists  evidence  that  noise  in  networks  of  neurons  can  dynamically  alter 
the  properties  of  the  membrane  potential  and  the  time  constants'.  Recent  work  by 
Longtin,  Bulsara  and  Moss^  (LBM)  demonstrated  how  experimental  ISIHs  measured, 
for  example,  on  the  auditory  nerve  fibers  of  squirrel  monkey^  and  visual  cortex  of  cat* 
could  be  explained  via  a  new  interpretation  of  noise-driven  bistable  dynamics.  They  in¬ 
troduced  a  simple  bistable  neuron  model,  a  two-state  system  controlled  by  a  double- well 
potential  with  neural  firing  events  corresponding  to  transitions  over  the  potential  barrier 
(whose  height  is  set  such  that  the  deterministic  stimulus  alone  cannot  cause  transitions). 
The  cell  dynamics  was  described  via  a  variable  x(t)  loosely  denoting  the  membrane 
potential  and  evolving  according  to 

Jt  - /(x)  +  Q  sin(ur)  +  F(t),  (I) 

where  f(x)  is  a  flow  function  (expressible  as  the  gradient  of  a  potential  U(x))  and  F(r) 
is  noise,  taken  to  be  Gaussian,  delta-correlated,  with  zero  mean  and  variance  2P. 
Potentials  can  be  either  soft  or  hard  (even  infinitely  hard)  in  the  bistable  description. 
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The  potential  used  here  was  taken  to  be  the  "soft"  function  U{x)  =  -  b  ln(cosh  jt). 

It  IS  instructive  to  point  out  that  a  bistable  model  of  the  form  (I)  can  be  derived^  for 
the  dynamics  of  more  complex  networks  of  neurons  and/or  dendrites,  under  certain 
mean-field-like  assumptions.  For  our  analysis,  the  system  (I)  is  numerically  integrated, 
with  the  residence  time  in  each  potential  well  (these  times  correspond  to  the  firing  and 
quiescent  intervals)  assembled  into  a  histogram,  which  displays  a  sequence  of  peaks 
w  ith  a  characteristic  spacing.  Two  unique  sequences  of  temporal  measurements  are  pos¬ 
sible  the  first  measures  the  residence  times  in  only  one  of  the  states  of  the  potential 
and  the  histogram  consists  of  peaks  located  at  r  =  nTglZ,  being  the  period  of  the 
deterministic  modulation  and  n  an  odd  integer  The  second  sequence  encompasses  mea¬ 
surements  of  the  total  time  spent  in  both  potential  wells,  i  e  it  includes  the  active  and 
refractory  or  reset  intervals;  in  the  presence  of  noise,  the  reset  intervals  are  of  largely 
stochastic  duration  The  histogram  corresponding  to  this  sequence  consists  of  peaks  at 
locations  t  =  nT^  where  n  is  any  integer  The  sequence  of  peaks  implies  a  form  of 
phase  locking  of  the  neural  dynamics  to  the  stimulus  Starting  from  its  quiescent  state, 
the  neuron  attempts  to  fire  at  the  first  maximum  of  the  stimulus  cycle.  If  it  fails,  it  will 
try  again  at  the  next  maximum,  and  so  on.  The  latter  sequence  is  the  only  one  observ¬ 
able  in  an  experiment:  the  former  sequence,  which  corresponds  to  the  refractory  events 
is  elegantly  elucidated  hy  the  LBM  theory  Analog  simulations  of  the  dynamics  yield  an 
e.xiremely  good  fit  to  experimental  data:  the  fit  can  be  realized  by  changing  only  one 
parameter  (the  stimulus  intensity  or  the  noise  intensity)  In  addition  to  the  peak  spacing 
in  the  ISIH.  most  of  the  other  suhstantitive  features  of  experimental  ISlHs  are  explain¬ 
able  via  the  simple  model  (1):  (a).  Decreasing  the  noise  intensity  (keeping  all  other 
parameters  fixed)  leads  to  more  peaks  in  the  histogram  since  the  "skipping"  referred  to 
aKive  becomes  more  likely.  Conc'ersely.  increasing  the  noise  intensity  tends  to  concen¬ 
trate  most  of  the  probability  in  the  first  few  peaks  of  the  histogram,  (h).  In  general,  the 
probability  density  of  residence  times  is  well  approximated  bv  a  Gamma  distribution  of 
T 

the  form  P{T)  =  ^^exp  \-TI(T)\.  where  {T)  is  the  mean  ot  the  ISIH,  It  is  apparent 

that  P{T)  -•  0  or  ixp(-TI{T))  in  the  shon  and  long  time  limns,  respectively.  For  van¬ 
ishingly  small  stimulus  amplitude  Q,  the  distribution  tends  to  a  Gamma,  conforming  to 
experimental  observations,  (r).  Increasing  the  stimulus  amplitude  leads  to  an  increase  in 
the  heights  of  the  lower  lying  peaks  in  the  ISIH  id)  Memory  effects  (even  within  the 
framework  of  a  description  based  on  the  theory  of  renewal  processes)  frequently  occur, 
particularly  at  very  low  dric'ing  frequencies;  they  manifest  themselves  in  deviations  from 
an  exponentially  decaying  envelope  at  low  residence  times  (the  first  peak  in  the  ISIH 
may  not  he  the  tallest  one).  (<■)■  The  mean  of  the  ISIH  yields  ithrougli  its  inserse)  the 
mean  firing  rate  A  more  rigorous  treatment  of  the  aNue  results  is  available  in  recent 
work'';  this  work  also  includes  comparison  of  our  results  with  recent  experimental  data 
taken  from  cat  auditory  nerve.  The  important  point  to  note  here  is  that  the  results  are 
almost  independent  of  the  functional  form  of  the  potential  IHx).  dejiending  critically  on 
the  ratio  of  harrier  height  to  noise:  this  ratio  determines  the  hopping  rate  between  the 
basins  of  attraction  in  the  absence  of  noise 

The  LBM  theory  demonstrates  that  the  peaks  of  the  ISIH  xannot  rxisi  in  rtw  ah.scnci' 
dJ  noise.  Indeed,  stimulus  cycle  skipping,  which  is  necessary  to  generate  a  sequence  of 
peaks,  cannot  occur  unless  two  conditions  are  fulfilled  theie  must  be  noise,  and  the 
coherent  stimulus  must  be  subthresholj  It  also  implies  the  existence  of  a  "regulalorv 
mechanism"  in  which  sensory  neurons  measure  the  stimulus  :im|ditude  bv  compating  it 
to  the  background  r.oise  level,  a  process  that  is  mediated  and  optimized  b\  the 
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(internally  adjustable)  potential  barrier  hei^t  in  the  bistable  model. 

HOW  GOOD  IS  THE  BISTABLE  DESCRIPTION? 

Although  the  LBM  model  provides  an  important  first  step  in  the  understanding  of 
r/ie(possibly  pivotal)  role  of  noise  in  sensory  information  transfer,  it  is  farfrom  com¬ 
plete.  The  results  do  not  depend  critically  on  the  characteristics  ofthe  potential  function 
U(x)  and  the  fundamental  question;  what  aspects  of  the  data  are  due  to  the  statistical 
properties  of  noisy  two-state  systems  as  opposed  to  properties  of  cells  that  transcend 
this  simple  description  (or,  can  the  neuron  be  satisfactorly  described  by  a  noisy  bistable 
switching  element),  have  still  not  been  satisfactorily  answered,  although  an  important 
first  step  in  this  direction  is  afforded  by  recent  work*. 

Integrate- fire  (IF)  models  have  been  exceptionally  popular  in  the  quest  for  a  descrip¬ 
tion  of  the  statistical  properties  of  spike  trains  obtained  from  exciteable  cells.  For  th; 
classical  Gerstein- Mandelbrot  (GM)  modeP,/(x)  ■  ;i,  a  (positive)  constant  drift  term 
corresponding  roughly  to  the  difference  between  excitatory  and  inhibitory  post-synaptic 
potential  steps;  the  dynamics  (1)  then  corresponds  to  a  Wiener  process  with  drift. 
Other,  somewhat  more  realistic  models*  assume  a  decay  of  the  membrane  potential,  fol¬ 


lowing  a  firing  event,  to  its  resting  value;  for  these  models /(x) 


+  corresf)ond- 


ing  to  Ornstein-Uhlenbeck  dynamics.  We  consider  briefly  some  recent  results  based  on 
the  GM  model  with  deterministic  modulation.  A  simple  extension  of  the  original  GM 
calculation  leads  to  a  closed  form  expression  of  the  probability  density  function  of  first 
passage  times  to  an  (absorbing)  boundary  located  at  a  separation  a  from  the  starting 
point.  Each  crossing  of  the  boundary  denotes  a  firing  event  which  is  followed  always  by 
a  deterministic  reset  to  the  starting  point,  accompanied  by  perfect  phase  locking  to  the 
periodic  stimulus  (this  is  not  necessary  for  the  theory;  in  fact  one  can  assume  a  random 
phase  4>  in  the  argument  of  the  deterministic  modulation  term  in  (1),  in  accordance  with 
what  is  more  common  in  experiments.  Then,  averageing  over  the  phase  leads  to  a 
smoothed  ISIH  which  differs  very  little  from  the  spontaneous  case;  we  do  not  discuss 
this  situation  here).  The  solution  of  the  Fokker  Planck  Equation  associated  with  the 
deterministically  modulated  GM  model,  leads  to  an  analytic  computation’  of  the  proba¬ 
bility  density  function  of  first  passage  times.  This  function  displays  peaks  at  locations 
nTf),  similar  to  the  results  obtained  from  the  bistable  LBM  model  (note  that  this  model 
cannot,  however,  elucidate  the  "hidden'  symmetry  corresponding  to  the  reset  events). 
The  peaks  are  superimposed  on  a  Gamma-like  distribution  characterizing’  the  0  =  0 
case.  With  increasing  inhibition,  the  density  function  approaches  a  Gaussian;  the  same 
effect  is  observed  with  decreasing  noise  variance.  While  the  driven  IF  model  reproduces 
some  of  the  salient  features  of  experimentally  observed  ISIHs  it  does  not,  in  general, 
produce  the  same  excellent  agreement  with  the  experimental  ISIHs  that  characterizes 
bistable  models.  The  formal  connection  between  the  two  classes  of  models  is  also  tenu¬ 
ous  at  present. 

We  now  consider  a  third  class  of  neuron  models;  these  are  the  so-called  Fitzhugh- 
Nagumo  models  corresponding  to  exciteable  systems  controlled  by  a  bifurcation  param¬ 
eter.  In  these  models,  when  the  membrane  voltage  variable  crosses  a  boundary,  a  large 
excursion  (identified  as  a  neural  firing  event)  occurs.  This  leads  to  a  natural  defir\ition 
of  a  deterministic  refractory  period,  in  contrast  with  the  statistical  distribution  of  ref¬ 
ractory  events  that  characterizes  bistable  models.  The  FHN  system  is  not  bistable,  but 
can  be  made  periodically  firing  or  residing  on  a  fixed  point,  dependng  on  the  choice  of 
bifurcation  parameter.  We  write  the  equations  for  the  model  in  the  form'^: 
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i'  =  i{v-  0  5)(  I  •  i)  -  vf  +  F(r) 

i2) 

vV  =  v  -  VI'  -  (h  +  Q  <;in{u'/)). 

where  v  is  the  aeiion  pnieniial  to  which  noise  has  been  added  and  w  the  recovery  van 
able  lo  which  the  sicnal  is  added  The  model  has  been  electronically  simulated  in  St 
Louis,  in  the  fixed  point  regime  ih  =  0  9)  .so  that  hursts  of  sustained  oscillations  are 
absent  Hence  one  obtains  a  randomoation  in  the  inter  spike  intervals,  but  some  coher 
ence  with  the  external  signal  is  maintained.  THe  variable  v  is  treated  as  the  last  '  van 
able  in  the  dynamics,  and  its  ISIH  has  been  examined  in  this  simulation''  The  noise 
was  colored  since  its  correlation  time  vvas  equal  to  the  time  constant  of  the  fast  van 
able  hut  much  smaller  than  the  time  constant  of  the  slow  variable  w. 

The  analog  simulator  has  been  described  elsewhere  and  al.so  within  this  volume'  '  and 
so  will  not  be  furtb  -r  described  here  The  fact  is  that  us'ng  it  we  have  been  easily  able 
to  reproduce  actual  experimental  data  obtained  from  periodic  stimulation  o)  craytish 
mechanorecepior  cells  In  order  to  reproduce  the  physiological  data  it  is  only  necessarv 
to  set  the  same  signal  lrei|uency  and  then  to  adjust  cither  the  periodic  stimulus  intensity 


I  ig  I  LSIH  s  obt .lined  frimi  the  s lavt ish  slimul.ited  at  (iX  b  H/  ( upjver  I  ,ind  the 
I  HN  simiil.itoi  tirixen  at  the  same  irequeiKx  with  b  -  0 '>  V_  =  I)  llT? 

T, and  V  ^.j,  0  S.s  iloaeii 

nr  the  noise  mteiisitv  .An  exami'le  oi  this  is  sh-uxn  m  I  ig  I  Moreover,  the  s|i,,ip 
signal  le.iture.  ch.o .k tei ist ic  ol  additive  noise  as  louiul  m  the  bist.ible  svsiems  .ii  p.'.ii' 
111  povvei  spi'^Ii.i  obt.imevi  btilh  Itom  i!ie  cravli-ti  .md  lioin  the  I  HN  mi'del  op, -i. tied 
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deeply  subthreshold  as  we  have  discussed  above.  The  crayfish  experiments  are 
described  by  Douglass,  et  al  elsewhere  in  this  volume,  and  so  will  not  be  further  detailed 
here. 
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DISCUSSION  AND  CONCLUSIONS 

Stochastic  resonance  is  a  cooperative  nonlinear  phenomenon  wherein  the  signal-to- 
noise-ratio  (SNR)  of  a  weak  time-varying  deterministic  signal  may  be  enhanced  by  the 
noise;  a  plot  of  the  SNR  vs.  noise  strength  demonstrates  a  characteristic  bell-shaped 
profile.  For  low  modulation  frequencies,  the  critical  value  of  the  noise  strength  corres¬ 
ponds  to  a  matching  between  the  modulation  frequency  and  twice  the  Kramers  rate.  The 
effect  has  been  extensively  analysed'^  and  observed  in  a  wide  variety  of  physical  sys¬ 
tems.  It  is  evident  that,  in  order  to  take  advantage  of  this  effect,  there  must  exist  a  form 
of  self-regulatory  meclisr.ism  such  that  the  internal  parameters  of  the  system  (these 
parameters  control,  for  instance,  the  characteristics  of  the  potential  function  describing 
bistable  systems  of  the  form  described  earlier  in  this  work)  can  be  adjusted  so  that  it 
operates  close  to  the  maximum  of  the  SNR  curve.  It  is  tantalixing  to  speculate  that  bio¬ 
logical  sensory  systems  might  actually  routinely  utilize  this  effect  for  the  processing  and 
transmission  of  information.  Our  studies  of  collective  behavior  in  large  networks 
show'^  that  the  coupling  to  other  elements  can  enhance  or  degrade  the  SNR  depending 
on  the  magnitudes  and  signs  of  the  coupling  coefficients  (i.e.,  the  excitatory  or 
inhibitory  nature  of  the  interactions  is  critical) 

The  precise  connection  between  the  ISlHs  and  SR  remains  somewhat  tenuous, 
althou^  several  features  of  the  ISlHs  lend  themselves  to  an  interpretation  based  on  SR. 
Perhaps  the  most  important  of  these  features  is  that  the  heights  of  successive  peaks 
(excluding  the  first)  pass  through  a  maximum  as  a  function  of  the  noise  strength'®*'^. 
ISlHs  obtained  from  the  IF  models  display  the  same  features’.  So  far,  attempts  to  quan¬ 
tify  this  'resonance"  as  a  matching  of  two  characteristic  rates  have  been  inconclusive, 
largely  because  of  the  difficulty  of  (numerically)  producing  good  ISlHs  with  low  noise. 
The  question  of  defining  a  "SNR”  from  the  ISIHs  is  also  largely  unanswered. 

Experimental  investigations  into  the  occurrence  of  SR  in  living  systems  are  now 
underway  at  at  least  two  laboratories.  Douglass,  et  al  in  this  volume  and  Douglass, 
Moss  and  Longtin'  ■  have  measured  the  SNR  vj.  noise  strength  curves  in  the  crayfish 
'echanoreceptor.  With  externally  applied  noise,  the  SNR  displays  the  characteristic 
bell-shaped  response  of  SR.  However,  another  and  inherently  more  interesting  case 
exists;  that  wherein  the  neuron  makes  use  of  its  own  internal  noise  for  subthreshold 
signal  transmission.  This  question  directly  relates  to  the  possibility  of  the  existence  of 
an  internal  noise  regulatory  mechanism  alluded  to  above  and  to  questions  of  the  evolu¬ 
tionary  development  of  sensory  organs  using  inherently  noisy  transducers.  The  experi¬ 
mental  difficulty  is  that  the  internal  neuronal  noise  is  only  indirectly  controllable,  via 
the  temperature  of  the  preparation,  for  example.  For  the  internal  noise  case,  the  results 
are  not  as  clear.  The  SNR  increases  monotonically  as  a  function  of  the  temperature  of 
the  saline  bath,  the  crayfish  having  been  acclimated  for  many  weeks  in  either  high  or 
low  temperature  environments.  While  there  exists  an  optimal  temperature,  that  is  a 
temperature  for  which  the  SNR  passes  through  a  maximum,  this  result  does  not  demon¬ 
strate  SR  using  the  internal  neuronal  noise.  The  reason  is  that  the  internal  noise  also 
decreases  beyond  the  optimal  temperature,  so  that  the  mechanism  which  maximizes  the 
SNR  at  the  optimal  temperature  is  different  from  SR.  However,  on  the  low  tempera¬ 
ture  side,  the  SNR  still  increases  approximately  linearly  on  a  logarithmic  scale  with  in¬ 
creasing  temperature  (internal  noise  intensity).  This  result  is  significant  in  its  own  right; 
it  points  to  the  existence  of  a  fundamental  nonlinear  dynamic  mechanism  underlying  the 
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cell  response  Nevenheless,  the  dynamics  underlying  SR  seem  to  be  the  most  likely  to 
provide  explanations  for  the  observed  effects.  These  (albeit  somewhat,  preliminary) 
results  lend  credence  to  our  speculations  regarding  the  positive  role  of  noise  in  the  det¬ 
ection  and  tjuaiiiificaiion  of  signals  by  sensory  neurons. 

Work  supported  b>  grants  from  the  US  Office  of  Naval  Researc.h 

REFERENCES 

1  i'.  Kaplan  and  R  Barlow,  Vision  Res.  16,  745  (1976);  H.  Treutlein  and  K  Schulten. 
Her  Uunsenges  Phys  Chem  89,  710  (1985);  0.  Bernander,  C.  Koch  and  R  Douglas,  in 
".Advances  in  Neural  Information  Processing  Systems  3',  eds  R  Lippman,  J  Moody  and 
D  Toureii'ky  (Morgan  Kaufmann,  CA  1992). 

2  A  Longtin,  A  Bulsara  and  F.  Moss;  Phys.  Rev  Lett.  67,  656  ( 1991 ) 

3  J  Rose.  J  Brugge.  D  Anderson  and  J.  Hind;  J.  Neurophys.  30  769  ( 1967) 

4  R  Siegal.  Physica  42d  385  (1991). 

5  W  Schieve.  A  Bulsara  and  G.  Davis;  Phys.  Rev.  A43  2613  ( 1991 ) 

()  .A  Longtm.  A  Bulsara,  D.  Pier.son  and  F.  Moss;  Biol.  Cyb  preprint 

7  (i  Gcrstein  and  B  Mandelbrot;  Biophys.  7  4,  41  (1968) 

8  .See  e  g  J  Clay  a.nd  N  Goel;  J.  Theor.  Biol.  39,  633  (1973).  J  Cowan,  in  "Statistical 
.Mechanics  eds  .S  Rke,  K  Freed  and  J.  Light  (Univ.  of  Chicagi.i  Press.  Chicago  1974) 

9  A  Bulsara.  |ireprint 

10  A  l.ongiin,  J  Slat  Phys  70,  309  ( 1993). 

1 1  J  lik'uglass.  F  .Moss  and  A.  Longtin;  in  "Advances  in  Neural  Iniormation 
Processing  Systems  4  ,  (.Mirrgan  Kaufmann,  CA  1993).  D  Pierson.  J  Douglass.  F.  Pan- 
tazelou  and  F  Moss,  this  proceedings. 

12  See  e  g  B  McNamara  and  K.  Wiesenfeld,  Phys.  Rev,  A39.  4S.s4  (1989),  F  .Moss. 
"Stochastic  Resonance  Front  the  Ice  ages  to  the  Monkey's  Ear":  in  Sumr  prnhli  ms  in 
SiJiistiiul  PInsus.  edited  by  George  H.  Weiss  (SIAM.  Philadelphia,  in  prese).  P  Jung 
and  P  Hanggi,  Europhys  Lett  8.  505  (1989);  P.  Jung.  Z.  Phys  B  16.  521  i  1989):  L 
( lanima.t.ini.  F  .Marchesoni,  E.  Menichaella-Saetta  and  S.  Santucci:  Phys  Res  A40. 
21 14  (1989):  M.  Dvkman.  R.  Mannella,  P.  McClintock  and  N  Stocks.  Phvs  Rev  Lett 
65.  2606  ( 1990).  P'  Jung  and  P.  Hanggi;  Phys.  Rev,  A44  8032  ( 1992).  and  Pnn  SaTO 
AH'^V on  Snxhdsnc  Risonance  in  Physics  Jc  Biolofiy.  edited  by  I  .Moss,  A  Bulsara  and 
,M  F  Shlesinger,  J  Stat  Phys.  70  (1993) 

13  A  Bulsara  and  G  Schmera;  Phys.  Rev.  E.  in  press;  A  BuKar.i.  .A  .Maren  and  G 
SJimer.i.  Biol  Cyb  .  preprint;  A.  Bulsara  and  A.  Maren.  in  'Vio^eedings  ot  the  First 
Applachian  Conference  on  Neurodynamics",  in  press. 

14  T  '/liou.  F  .Moe--  and  P  Jung;  Phy.s.  Rev  A42.  3161  (  1991 ) 


